Papers by Harish G. Ramaswamy
On Knowledge distillation from complex networks for response prediction (N19-1)
Copied to clipboard
| Challenge: | Recent advances in Question Answering have led to the development of very complex models . however, these models are expensive in space and time and require limited resources . |
| Approach: | They propose to use simple models which learn to emulate characteristics of a teacher network . they use a 12GB Tesla K80 GPU to restrict the maximum length of the input document . |
| Outcome: | The proposed model can perform better on a Holl-E dialog dataset. |